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DD/A "'.ouistry 






1 DEC 1976 


MEMORANDUM FOR: 
VIA : 


FROM 


Deputy Director £or Intelligence 
John F. Blake 

Deputy Director for Administration 

Charles A. Bohrer, M. D. 

Director of Medical Services 



2 DEC tm 


SUBJECT 


Assessment Centers 


1. In the continuing search for ways of improving 
Agency management, the potential of assessment centers 
for Identification and development of managerial talent 
receives periodic reexamination. At the request of the 
DD/A, I recently reviewed with him our activities in this 
area within the Directorate, In the course of our dis- 
cussion, he observed that other Directorates raay want to 
reconsider at this time the possible application of this 
method and suggested that I bring the concept to your 
attention as one worth looking into. 

2. The Management Committee discussed the subjject 
about a year ago but took no formal action. A background 
paper prepared prior to that discussion is attached. 

Should you have any Interest in exploring this further, Jack 
Blake and I and members of my staff would be pleased to 
respond. 

SiGxrN» 

Charles A. Bohrer, m.t> , 
Charles A. Bohrer, M. D. 


Attachment 
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Assessment ^ Center Approach to thc Identification a nd 
P-P ve i 0 P me flt of Managers in CIA : A Ba ckground P aper 


8 OCT S75 


Typically in the public Service, the process of identi- 
tymg employees as possessing managerial potential is based 
largely on their past performance in a technical specialty. 

One strategy £or overcoming the inherent limitations o£ this 
ppioach mvolves the use o£ multiple assessment techniques 
espectaHy those inveiving a Simulation of conditions a2d ’ 

. Problems which the manager actually confronts on the job 
Properly designed, such techniques can permi t an evaluation 
of managerial skills by replicating thoso interpersonal 
a ministrative, and decision-making demands unique to that 
particular _ organizational environment in which the manager 
must function. Integrated with traditional Information innuts 
mcludmg Supervisors' evaluations and the performance re?Srd 
such data can materially enhance the predictive accTvtcy of ' 
managerial selection, identify individual development needs 
and enlighten senior management on the characteristics of its 
managerial pool in relation to projected requirements and 

F ln sum ’ su ? h techniques offen management an 
additional tool for predictmg and directing the canabil i t i pc 
character, and style of the Organization. S P blllties » 

in August, 1972, a Journal article setting forth these 
Dircctor^ 6 ?^ 0 a- attention of Mr. Colby, then Executive 

Su^noJ? M. ? ng 1 the art ^ le to the Deputy Director for 

Support, Mr. Colby made note o£ the fact that OMS psychological 
assessment is focussed primarily on initial selectioSaSd farlv 

"?he pofsibilUv of a a 'm ? 1 that t ^‘° article raised in Ms mind 
ine possibiiity of a 'mid-career ' assessment to identifv ctrnn«r 

and weak points at that stage, for training and leadwship g 

development purposes if not for raw selection”. P 

hoi ^ t ^ is p° int > the OMS Committee for the Behavioral Science' 

subi erfand f e Y oted f ® erie ? of meetings to this sarae general 
subject and had. reached a similar conclusion. In respondinr to 
a request for comment on Mr. Colby's note, the DirectX of 
Medical Services concluded m a memo to the DDS that "we shon'ld 
try the Assessment Center techniquc in the Agency"? 

dw,Ä qUently - the DI)S nnnonncod that OMS was prepared to 
discuss the concept with interested Offices and to reruW 
assistance to any office which chosc to dlvel?p a 2eJ?er? The 
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Psychological Services Staff was designated as the resource 
for such development, and this respons ibility was later formal- 
ized as a Directorate-level objective within the MBO framework. 
Discussions with several Offices ensued, and eventually a 
developmental effort was begun in the Office of Joint Computer 
Support. An OJCS Center was established. and continues, and a 
similar effort is presently underway in the Office of Communi- 
cations . 

As with any new venture, niany Problems arose between the 
idea and its fruition. Progress hasbeen painfully slow. Ex- 
perience to date affirms that the concept is basically sound. 
Full understanding of the concept and anticipation of some of 
the problems at the outset are essential in evaluating its 
potential for any givcn application. The balance of this paper 
attempts to deal with these matters in some detail. 
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oss Assessl^Itllr3'been“? e «ded i by e eIr?fe? f wo r k S - 0f thß 

C £J\E P t£ £ S§§ expo e ^^e BO r rd f^ “ d -«“"«Her in 
fluenced the later development of assessment mSthod™fo? • 

f« 1 ™? 1 Applications . Concerned sololy witt seJec«on 

RSiÄ-äSiiffilr 

the voiumfof^dJdafe^docilned^f’^rtL^a^flls^s' AS 

on2-cf^fd U a a t 1 ^ 1 S“L e t d i^ 0m w a tr? UP > rOCeS ? to ar a y o^ B Lless a o?? SS - 

and heavier reliance on the stind^i US ° , OL Simulation exercises 

struments appropriate to the one-on-o^Tassesfment conduf"® in " 
Exceptions contirmprl in + cissossmcnt condition. 

programs) ? t ^ter^tl required (e * g . ° pilSts^or^he 6 »!» 8 ^^ "0" Clal ~ 

with uniqüe qualif ication^f or demandlng tasks e p c?mitted £f ndidates 

between individuals who were all hi*hlv ah?? 1 * 1 ^ 0115 rec i ulred 
special U f ield f T «andingly successftd acMe^meSHrtSoi? 0 ” 0 " 
to the ols model !S^eSS#Sf' how 035 " 16 " 1 adhered “« elosely 
Psychological ServicesVa« ^mosr?yp^a?]y e co S ns?st PO o? y » by ‘r, 
bemg seen for one day by a psycholoiist \tL st V ° f . a candidate 

m hand the results of the candid^e'f LJ f ’ often having al ^eady 
fessional Test Batterv uses d ? P e rf°rmance on the Pro- 

frorn Interviews and witteS nJoJL 1° obtain additional data 
of the psycholog ical W factors^whirf UreS t0 ff 1 together a Picture 
With this picture in mind he then nromr 1 10 can didate's behavior. 

descriptive in natu?e geared S' ?h?' ISifaM? -? aTTativ ? report > 
concerns of the ref erring office. uitability questions and 

the OSS Operation 1 °users t of Aapn Ctl ° n , question which governed 
often concerned with questions of • essme J 1 Services today are 
and potential growth Ts tlu It U direc \ io ^ 

assessment is a management device usecl most Sf ten ?n°r?A ’-f 3t 
applicants and £ox guidIovpoc; -in t’iirx ^ CIA for 

The relative. ly few persons seen a t Ptf ^ sta gos of their careers. 
often referred becaSse '-n?ohie!^\ career stages are most 

seen as a techniqSe to f a 'f 15Gn and as ^ssment is 

to do about it. 1 x g ure out wlia t went wrong and what 
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In other quarters, meanwhile, the OSS model triggered 
a rather different set of developments . Following some unsuc- 
cessful post -war attempts to apply OSS-type assessment methods 
to select ion of candidates for specialized Professional training 
programs, the approach feil into temporary disfavor. Ten years 
after OSS, one of the most prominent American psychologists 
declared that assessment in the OSS tradition was a proven 
failure. While this death notice was remarkably premature, 
there were few to dispute this judgment at the time. Few if 
any major assessment programs were in Operation during the 1950's 
outside of .the CIA. 

However, it was in 1956 that American Telephone and 
lelegraph quietly embarked on a program which was later to prove 
how wrong this judgment was. AT§T launched a long-term, ambitious 
carefully controlled research effort to study the management de- * 
velopment process in the Bell System and to identify the variables 
related to managerial success. Assessment methods were incorpo- 
rated into the basic research strategy. It was several years 
later before the results came in. When they did, the data 
demons-trated conclusively that OSS-type assessment methods could 
identify managerial potential, and do so more effectively than 
conventional methods relying exclusively on job performance in 
sub-managerial positions. This finding led to adoption of an 
assessment approach (now dubbed ”the Assessment Center"j through- 
out the Bell System. 


When news of this success spread, similar efforts were 
soon launched m IBM, General Electric, J. C. Penny, Standard Oil 
and other prominent Companies eager to emulate the AT§T success. ’ 
Literally hundreds of other organizations followed suit, including 
several government agencies, among the first of ivhich were Internal 
Revenue, the U. S. Forest Service, TVA, and FAA. Not all of these 
a.ppl icat 10 ns were marked by the kind of careful research effort 
needed to establish their validity and usefulness. But many of 
them did, and by now the volume of research evidence testifying 
. e . soun( ^ ness method in a wide variety of settings is 

sufficient to suggest that almost any Organization intent on 
improving managerial selection and development should give the 
concept serious consideration. 

n D escription of a typical Cente r. An assessment "center" 

o± course, is not a place but a process. The process involvcs 
the systematic application of a set of procedures for evaluating 
people . The procedures are devised and selected to have the 
maximum possible relevance to the managerial job on which the 
assessment process is focused. The process consists primarily 
of placing mdividuals in problem situations - -siinulations of 
real -lif e tasks- -which they must handle, while their behavior 
is observed and evaluated by a team of assessors. The situational 
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tasks are developed jointly by psychologists and managers to 
reflect key aspects of performance in the managerial 3 ob in 
question. Typically they include an in-basket exercise, a 
leaderless group discussion, and one or more management "games", 
all designed to elicit managerial thinking, decision-making and. 
action. Assessors are drawn from .Tine management of the Organi- 
zation, typically two organizational levels above the assessees, 
and trained from two to five days in how to observe and judge 
behavior in the various assessment exercises. Assessment is 
conducted off-site and away from the work environment, over a 
two or three day period. Genera.lly, no more than six people are 
assessed at a time, with one assessor for every one or two assess- 
ees. In-depth background interviews, peer evaluations, and video 
recordings and playback are also included in the process. A 
profile of strengths and deficiencies on each of the dimensions 
previously identified as important to 3 ob success is generated 
for each participant. Performance is not judged as pass or fall; 
it is rated rather than ranked, and feedback to the assessee is 
provided orally or in writing. A written evaluation is made 
available to the appropriate persons in the managerial structure, 
varying with the basic purpose of the assessment center, which 
may focus in varying degrees on selection, training needs , or 
other aspects of career management and development. When develop- 
ment rather than selection is the primary goal, the process is 
sometimes referred to as the "Management. Development Center" 
rather than "Assessment Center"- ~a perhaps more acceptable as well 
as more accurate term. The OJCS Center has been so labelled. 

3 . Steps and Problems in implementation . While the de- 
scription above outlines an essentially simple mechanism, some 
reflection on the implications will surface the fact that the 
assessment center is actually a profound departure from tradi- 
tional apjjroaches to assessment in both the OSS and the CIA. It 
differs not only in focus ing on managerial selection and develop- 
ment at a later career stage, but in more fundamental ways as weil 

The OSS Assessment Staff was a semi-autonomous unit, 
staffed by experts in human behavior, which developed its own 
Standards and delivered candidates into the System judged by 
those Standards. The Assessment Branch of the Psychological 
Services Staff is likewise a group of experts who, operating in 
a Consulting capacity , feed into the system interpreted data and 
their Professional opinions and judgments about individual assets 
and liabilities. They do this by relating their psychological 
conceptions of the individual and their knowledge of predictive 
relationships between psychological data and everyday behavior 
to the general domain of 3 ob demands as they understand them. 

The assessment center, in contrast, proceeds from a quite differ- 
ent set of assumptions. 
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First in importance is the assumption that the require- 
ments of a given managerial position, for example, that o£ Branch 
Chief in a given component, constitute a set of demands unique 
to that position which can be (a) ident ified by careful job 
analysis and (b) once identified, targeted by specific assessment 
devices which will elicit behavior relevant to those demands. 

It follows from this that the first Order of business in planning 
an assessment center is for the office concerned to decide what 
target. positions should be the focus of the effort, after which 
a detailed process of analyzing what the incumbents of those 
positions actually must do to. perform ef fectively .begins . 

In some cases, this step is slighted, based on fairly 
valid reasoning which holds that all managerial positions embrace 
certain common elements: oral and written communication skills, 
energy, flexibility, creativity, etc. In our experience to date, 
short -circuit ing of this step is ill-advised* While such coimnon 
elements surely exist, their relative importance varies consider- 
ably. For example, careful job analysis in one office established 
the fact that ’Jability to delegate" and "keeping others informed" 
wert critical J ob elements at the top of the list. - -far more im- 
portant than, for example, flexibility and tolerante of stress. 

For managers at the same level in another office, this Order 
might well be reversed. 

A second assumption of major importance is that once 
a center has been- proper ly designed to elicit job-relevant be- 
havior from the assessees, line managers, not psychologists are 
the_ appropriate persons to judge the eff ec tiveness of that be- 
havior. (This assumption is supported by research indicating 
that tramed managers do at least as well as psychologists in 
predic ting later managerial performance from assessment center 
data.) Using line managers as the assessors takes the psychol- 
ogists out of one of their traditional roles but continues to ' 
use them where their skills are highly relevant: in job analysis 
construction of assessment devices, training assessors, con- 
solidation of the data, and as Consultants in the Overall Operation 
of the center. In their training fuction, the goal is specif- 
lca -iiy to make psychologists out of the assessors, but rather 
to sharpen their objectivity and systematic approach to Observa- 
tion, recording, and integration of the behävioral data, 

. From this shifting of roles corocs also one of the major 

f ringe benefits of the center, namely , that which accrues to the 
manager from his experience in serving as an assessor. OJCS 
assessors extol the value of this experience, and General Electric 
feels so strongly about it that it has established a policy of a 
1-to 1 assessor-candidate ratio and rotates managers in the 
assessor ’s role to expose a substantial percentage of its managers 
to this experience. 
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A third major assumption implicit in the process de- 
scribed is the necessity of incorpora ting the assessment center 
as an integral part of the personnel management machinery. Most 
Agency components already have a variety of mechanisms - -career 
boards, promotion pancls, annual evaluation procedures, etc.-- 
soine quite elaborate and functioning very well. To embark on 
an assessment center Operation without- carefully thinking through 
where it is going to fit into the System and how the output of 
the center will be integrated with the function of these other 
mechanisms is, at best, an invitation to resistance, confusion, 
and ineff iciency , and at worst, a blueprint for disaster, 

While this may seem öbvious, o ne of the factors which 
makes it less so is the long tradition in CIA of regarding assess 
ment as something that is done by "the experts"- -an outside group 
to whom you send people and get bock some hopefully useful In- 
formation about them. At first blush, it may appear that the 
assessment center also is something that "the experts" are going 
to provide, with the added disadvantage of requiring a heavier 
investment of time and effort by the user Office than before. 

The idea that the center, if it is to come about, must be "built" 
by the office itself, and once built, "belongs" to the office in 
the most literal sense, with the "experts" only advising and 
helping in its creation and functioning, is not all that readily 
perceived at the beginning. Coming to grips with these issues at 
the outset is essential to realistic appraisal of the pros and 
cons of embarking on such an effort, and great ly enhances the 
chances of a successful outcome if one decides to proceed. 

4 * Considerations for the fu ture. The preceding discussion 
has attempted to outline some of the' problems and difficulties as 
well as the benefits of using assessment Centers. They're ex- 
pensive. Resources to mount such efforts are limited. In the 
more than three years since the idea was first seriously broached 
in the Agency, progress has been slow. But they work. And they 
work here. Improved managerial selection and development can 
result at almost any managerial levol. 

In 1973-74, assessment centers werc used for the first 
time on a government-wide basis in the final selection of 25 
candidates for an executive development program open to nearly 
all GS'15's in the government. The Office of Management and 
Budget, in Cooperation with the Civil Service Commission, 

Sponsor ed this program, which eventual ly resulted in 100 selected 
applicants participating in an assessment Center conducted by 50 
high-level government executives trained in an B-day assessor 
training program. The assessment ccntcr included a government 
.in-basket, a group discussion simulating the cabinet of a hypo- 
thetical country, a group discussion on national priorities, a 
mock press Conference, and an analysis problem involving the 


-7- 


Approved For Release 2002/03/25 : CIA-RDP79-00498A0002001 20020-4 



Approved For Release 2002/03/25 : CI A-RDP79-00498A0002001 20020-4 


Staffing of a government agency. 0MB expressed the hope that 
this effort would be a prototype of a much larger government 
effort in this area. 


Use of assessment centers with minority personnel 
and women have had favorable results. In one landmark decision 
mvolving litigation beti^een ATf,T and the EE0C, a consent decree 
provided that AT^T open i ts assessment centers to 2,000 female 
College graduates in lower level management positions to de- 
x:rnn ne their potential for higher level management positions. 
Other experxence in the Bell System demonstrates that' their 
assessment centers operate fairly for blacks as well as whites. 

^ A recent "communication from 0MB to the Comptroller called 
upon the Agency to see that budget estimates "re'fJect full con- 
sxderatxon of---the resources needed for Agency Systems to identi- 
±y, develop, and utilize career executives . " Assessment centers 
would clearly appear to qualify as one such resource. 

uddition to internal Agency resources for hastenin«? 
the development of assessment centers, a number of external re- 
sources are readily available through Consulting firms who special- 
l activity. Should the Agency deci.de to implemen/this 
approach at a faster rate than coulcl be supported solely by in- 
house resources, the Psychological Services Staff is prepared to 
identify and recommend such outside sources of- ' ' F 1 
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